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Abstract: 

PROBLEM TO BE SOLVED: To provide the method for interpolating distance data in an area where a 
distance measurement can not be made in a distance image and to provide the method and device for 
making a color image hierarchical by using the distance data. SOLUTION: While a distance image is 
picked up by a range finder, a color image is picked up by a CCD 10. A distance data interpolation part 
17 uses the picked-up color image information to find distance data of a pixel of interest from distance 
data of circumferential pixels through weighted interpolation corresponding the difference in color and 
the difference in pixel coordinate value between the pixel of interest and a reference pixel A 
hierarchical constituting process means 18 makes the color image hierarchical by using the distance data 
and the extracted image is put together with other images by an image composition part 21 . 
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<BTiBf|3*vC»,»S) . *fc. (81 ) ©tf^B. fi* 

[006 3 ] (81 ) -cagf^fcCitt. pftSfflf 

(c4)tt«*ginR&#jimm©Eiiflm r x.yfdjn* 
r. fe^ra*(ctew^#@iisgt#Mia^^©^st«^ 



ir&S. #&6n/cS&tf^8B#Mii*©iE8S7 I 

[0064] c©J:3Cc. (81) Ot»ttW 
B, ftBHJRKfctf *B. ^aH*i#MBi 

^raoffiSfflcaiciStfRGBOia^fflofi^cciEcr 



XL 



sEBf-fB. B*™±-c©rat*sifi< (abb* 

moM^ft'PteO , fiCDjgl* (RGB©@i#fii©jH,> 

J: 9 KMB «±©J: 9 K*5US©»»{c <fc 
ti«. BBBB4BBKaW*tfc#9--BB©BB*B 
i>. EB^-*©M!BB«rt©»BB»i#BBBB-c 
©e©ai>. teJ:s>'. BBBBfiiojtwcfScfcBatt 

WBBKJ^T. BB* s -**BB©BBK:*tf.5BB 

[0 06 5] £©*SIH. MHlcJcOEII^-jrjWKAiR: 
«»e>hA:IR«*dtrtBiliMil©tt* • WBB©«» 

a. *5-BB-e©B* • w*iB©«Wi»tt«t<-a* 



(7) # B 2000-230809 

12 

*T4. Ufc*5,t, BBflB©6-?BBl1tB<c£-3** 

5-BB©-Bcw*.«BB)4«itW3B. 

*5-BB(BB)©BBK:. ttfOfe^ltotW 

[0 0 6 6 ] fcfc, $HiS©^{cfcW^,SEifr-$© 
K«B*C©BBtt*£B» <Bl) K^r*>©K»S 
sBBBfc<. Tie© (B2) «c^rfe©-ctJ:i>. 
10 [0 0 6 7 ] 
[B2] 



d{x,y)- 



■ 1 2 



' r + 



cc-e, (x,y) li»§B*©ffi»(Iv 
(r.f) «#BBjR©ffifftt, 

r^-( je - J ) I + 0'-') J BB2B+-C©»HBBfc#BBBB©EB©2B. 

&gB*-C©&gBB2:#BBBB©EB<D2B 

[0068] <B2)TB. (Bl) (Cfctt&BBftB *S4)?B. (IS! 1 ) , (B2) K*W4BB2B*T© 
A#BB3ftt:i>*. BB©2BieaB*T?©BB©2B*. BBBB«t»r 

[006 9] *fc. BBf-JOBBBBSB. (B ©BBie2BtfrC©BBR:fi*»*.fc<>©-e**. . 

1), (B2) KB£3ft&6©-CU&<. <B3) . 30 [0 07 0] 
(B4) K5frt©tBWLtfcJ:i>. (B3) . <B& [»3] 

fc L +xY 



::ts (*,>) ttBEBBaflMMlL' 
(s,f) B#BBB©BBB, 

r^-yKx-sf + iy-tf BBffim>p-c©*§B£fc#BflBB©EB* 
Tfcto^ BgBf^aBlBBfcBBBBBOBBx 

A tt££{b« (£B) 



[007 1] 



[B4] 



(8) #K2 000-23080 9 

13 14 



j W dv 



d(x,y) ^ ' r ' os 



& r + 



1 .* 



Tjlcb 



[007 2] ^JSO^fcfcWiBSIif 5 -* (»5) . <»6) ft^-T 

©iPinsitt. («3) . (»4) jcijorm* s»a*»ffl-rscifcraF5. 
*r©#s«*i#j8H£fy3©ffiMi©g©i^ii©fn [&5] 

Cut, 

|^,y)-/i{, f J + |c(, (r )-G( y ,^^,y)-B(v| 

afeSfat-coa sax t #»siiiiira©fe^^©g©*gwtt©a 

A l±SSft« (£»} 



[0 07 4] X * [RB] 

*l«-^|y-i| + |Rfcy)-AUr^|Ofcy)-cfc»^|B(x.jp)-^ i i)|* 

|*(*. y) - *(r, x]( + |Gfo y) - G(s, t) + |i>(x, y) - f J 

(±fe2PJ4»-c©aiii3Rfc#siiiip«a©fifi£^©s©tgWffi©«j 

[0 0 7 5 ] Sfc. il^D^SK&bWaHlfl:^-*© ©if£, tttWIBI4JSIfrCS4 » 
WHSW«:*ji>t«. ISiSi#©fi#S8±©:£-c©«i£ [0 07 6] *fc. ffifitf 1 -* ©ffllHSHB. S&Mt"- 

#jHH«i«r. «^±©&wtfc*K#flis**fi8 *©K»MiS£&Ts/iH©ii^£«#sg£?-£ii£»# 



15 

fTo-r*>iai*©is**»*ci36«T**. <*6tc. b® 

fcra«©»**»sc £*!T?& 3. Sfc. s»#©»# 
««rtr©^r©BW*#Jliii3Ri-r4**3 0{c. #JK 
©ttBStfc £ cc T * <fc 9 K |B9 1 t > r . 

[0 07 7] «JJ*W0fcSBi'f-***»*»ff4* 

WKJAtHL (Xf-^STl) . iWc, ggf^-*© 

xwmicm igmmfcomm?- * k , * 5 

rofeoai >*» «fc o'BHffi«ffi©ai > (cj& d fcS^fett 
2) . 

[0078]i6tt. §10^f-A(Cfcl«, pgJUb 

[0 07 9]EW*S*i*J:9k:. HUttfeSWl 8tC 
tt. fl-*HMeo<,>T©reiHBflt (S5) i*5-B« 
j&tffeWKAASti*. C©»Jlfb«Hi»l 8tt. 
ft£S&$IB«s ( S 5 ) ©Ef8tB«ffi4i3lf5£©L#l>ffi4 
*Jfc»U *©*BaS**litfJ-rstt«^R5 14. w 

[0 080] J±$$3M85 1 ©flSEOlS*. KiHB^©fii 
#L*i>fi*SS©»£K:tt. fflffl-#ll*JR5 2tt. * 
7-B§! (S3) ©B*ffi£. ffiUSB& ( S 6 ) 4 LT 
HttfU ffiSiltB, «S±. -5£©BSM (« 
AttH*>i»«) ZtitttZ. IK, IE$iB®©ffi#-£ 
©L*lHWJLh©iJteK:tt. #5-B® (S 3) ©B£ 
t/CUtfjU ttftUft (S6) «C«. <g 
fth. -5E©B*«*HtfJ-r4. C©J:9«c«ffll«:j:-5 

r. itjttWfttaMu 9i»©&£«ittj-rac4**-c 
[008 1 ] ±a$o/c4teo. EmMttflmorot 

/c&, IEII?-*©&ilWM#tt<. Lfrfc. 

* • mnoww:. *7-b^t©b?« • wmom 

[0 08 2] &*s. ttm&9&t/&t>flMft*;B<>>-c 
pmh b*tr 5 «. mm^vmrnnmrn * u 

frofcBJ&tcoo-ttt. mtt. SaSKlSflSH©*** 
<B£3ci»-r6^. -S©ffilllB4*«-r*{:iKJ:0. 
*7-ffl«©^B3RCcoc»-cffiBIB«*ffl^/tFi«fb* 

ftsc s. «±©«t^{c. *nii©^.mj:n 

tt. H§8tB« : &fflt>SC4{t<fc9. W**#-©e«c-J- 

sc£&<fwii»*6A^©fr*4ttHiu 

B^©Pg)f{b4tf ; )c4^r^S. &*$. *J65l©ffJ!i 

?tt. ®m<otcit>2m<mmittcr>i>xi&wLt)iifi, m 



(9) #&fJ2 0 0 0-2 3 0 8 0 9 

16 

m> L t^WmK. J: 0 PgJltt* 3 «±{CtT 1 S C 4 tt 

[0 08 3 ] (m*®jm 2 ) a 7 «. *£tt©£Atc 
[o 084] mmztizjz'ytiC* vy'yyy -i^mm. 

tt, £S3 0 4. X y 7 h 3 1 4, «tfc©i£liB®}i{f! 
ffl*y^3 2 a-3 2 c4, rt^-BftJf&ffl*^ 3 
44. X'j » h|gSbgP354. mm ■< S>y$UfflIg|53 
10 6 4. B<£&fflSR3 7 4 . SBStftStSP 3 8 4 , 86Ii$£ 
933 9 4. *JWWS. 

[008 5] nm&mBjgmrcK* $mmmm&? 

5*y9£*5-H«*tt«TS*^5©#W«jStt 
-SL/T^fc^. *I5»©»JB"CB. M^tt^F-Sr* 
•5. tCT. $Hffi©}f^T?tt, ffimHR<b*7?--B* 
©8L£*-a 3 -ea^. 5. 

[ o o 8 6 ] a 8 », *jiis©^{c*jw s t 1 - n 

8B©*fiS**T^n?*l8-e*.5. H8©flM(tt. H 
3©«W54B«iaiC'C*4*». ffi*. 

20 saia55 0*«KW6Jhrir>s^"e*!c*. 

[0 08 7 ] ^.^81355 Ott. raiBflt (S 1 ) 4SE 
«^-*©MWiW«JglS**w-fB« (S4> 44A 
734 U «Bft*«j*iaaftO-C. *9-B*©ajS«:- 
g(§#3. TIB© <»7) K^-TSCKJ:?) 

[0 08 8] (»7) KfcOT, a*»<7^-$A 

(X, Y, Z) *5KfeI©!g)(*4*7-B»ffl^^vr» 
*5-B^-C©)i«<ii (x. y) 4gt*a©3^7C 

30 mm®(x, y. z) 4©ffl4a^n-s'jL/, m>b2m% 

■Ctt»{CJ:l3A-L4z^L/, KE*tf5 • 
[0089] 
[»7] 

^ -4- ay + cz 4 p 

*" IX +JY +KZ +L 
) "* flf +JY + KZ +L 

[0 090] «±©<fc 5«:4**©«*«:J:htf. SgfH 
Bfll 4 * 5 -H«©aj£»*JMc S Jt^K t . W#©« * 
40 4-S(3ti5C4(cJ:i3, *9-B»©tt«*ffl(r>'C. 

7 r -**>6i&rr&c4#iT , s£ < , c©i»#, 

«I?B. *7-B«fC©fTM • WM^©^l?4KfflSK: 
-gcT3«fc^Cc%0. KSIB«*ffll<»fc*7-B«Pi« 
{bB#©g!r^^<*»ll5©^Hi*IS ; S:|Sj±$-&5 C 4*ir « 
3. 

[o o 9 1 ] tit. 2RWfc©»»«:j8i>r«. aaeeoft 

£U-C«£a»K-3(,»T&*<fc*». TiB (K8) ^ (tt 
50 9 ) Kit 1 &SHJ«> 2 . 5tCCSiBj L/cta*^ 



(10) 



17 

[0 09 2] 
[&8] 

^out m fain y in 



[009 3 ] 
[&9] 




1 

X- \ 

u 1 

1 



10 



[0 09 4] C*xiC<fc>3> ^^©^©iit^fliE-f 

[0095] (mmmms) H9B, M6©^ssi© 

SBBKfrfr 5ffiBtil»«rffl^fc* 7 -Hft©nMMb4*T 20 

[0096] H9Ktot>r. JNNMgtt 1 ±|3J-©ttf¥ 
£-*--5fc©K:ocvcB. El 1 iH— ©#^4#L/, 

[0097] ^atOISIi. gra©£gffc©J&JR<!:HS 

CC. *5-*7y5r»«ofct^#©etil*fc#«UT 
XaUdS^-^MU E*tlHllfr6f!]»r3ftS 

©«W£-SStfSJ:9K:i,. #?-Wfc£H3lilli*4 
[0098]/c/ci, *H)!i©^^r«, iffl^oii^fii 

<*5Hffl*T:**i«Il. G. B©3&jc©«f*aBUC 
WSHi) *tMR©*9**fcflaiU EftHfc© 
8W*»Sd>?a*©»WK:-3W-4J:5(c. IEUt*-* 

[0099] -rfttot. fid>n«c«i(Wc*7c>rB. m 
#w>ts**Hiif $ ©mmskm-c 6 fe©T* 

6. 

[oioomr. ^x^io^sin 7 0 1 isast^ 
-*©hm»i 7 0 2©sdmcoi>rsiwrs. 

[0 10 1] ?y*it<)>?2t>l 7 0 IB. #5-iHfc 

©*5**y>y (swkhw) i£»©*7** 
>j>^«, #&©■&£. «*©*j-&»#ih* <*5 
tc^-r^s -?$>*). cfttcj^-cHffc©*^ 

©ifcO, RGB^iicfeW5Wi©}'7^i";>i' 50 
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[0102] HSUii 

■iTCfttitfR. G, B©3#7c£RBtCtett&ij3&ffi) 

*«»©i'5xit{c»ar*fc©-e*nttj:<. wcr 
[0103] ^ut©»«"CB. >^©^a 

ilt, k-meanS (kW7*rf';Xi>) *ffll>5. W 
T. k-raeartS«COC>rt»Bjri. 
[0104] k-meanftB. 

tcW«Di> y ZtttCft&fZ7)l>3 'JXA-C&Z. kwnean 
jS«KT©«©^«K:J:0 y >y*trfc9. 

(1) *7X*£St. »7*ft©»3£. 

(2) VmtyXZZWS.. 

(3) ■?-£©£§. 

(4) »7«E. CR7l/ttlr>*teK:«. (3) (CR 
S). 

«at©?l5fflfr«*5^a»l!i»is©«iii/r^ii* 

(WLBl 0) . *fc. irr*tttt**5*i»«:BB3 

©«9iiLltff©0«3&»-5i©E« («*.«UH) Kjg 

[0105] tBtt99XH ©SMB. *©W< 

Sfoci* (810) 
[0 106] 
11*1 0] 

ci-m + a(2(i-l)/(/i-l)-l) 

[0107]CCT\ ntt?7X$S(, i = l, 
2 n„ 

[0 1 08] *5X2'J>^g|n 7 0 ltcj:**?** 

[0 1 09] 01 0B. ^X^iHJiHT 1 ---*©**^ 
*OfiBEMtS*^rHT*«. Hl-Ortt. flM*©fc» 

Office ^13. ■^©nst*. ?yxfi (&m& 

90 1)*6i'7X$7 <«Hff#9 07) ©l>m*» 

[0110] @10Ktel>t, a»t»LtwJ 
tl£MilS9 08a, 9 08 b, 9 08 c^ ffifir-* 
©KflHMi'C**. H^Sti*J:9{C. ffiSf-f-*©* 
flHR«9 0 8a8*5X*2 <#J1RW9 0 2 ) KM 
L/. ©■^--^©fcilHWflQO 8 bBf 7^*5 
?f#90 5) CCRL. Haf^-*©K»W*9 0 8ctt 
*7**7 (#RS##9 0 7) iCJSLTt^S. 

[0111] Xtmm 0 8 a~9 0 8 ctefcl* 
^.ffififii©^ (W) *ffiK-3(,>-CI»9!rS. S9CC 
fct,>-C EK^-fOfflBiai 7 0 2B. HE^ItSCgBl 



IS 



ftffl 2000-230809 
20 



[0 114] c©S*>6fc*>aj:5«:. Bit?*-*©* io Jd8©x*A'4Mn^^fi*R'5*fr«> St»ffE = 

»Mi$Kfctf£x*;b*--EB, am© (x, y) £g o ilt. «T©J:5«:tt4. 

i. Sldi. Hld©HRx(Cj:&4M£&. ggitd [0 12 1] 

TftI*U Cft{c«#fli«w (x. y) *m&Ltcb<D 8xdx d3? *" 

tWMAicobiniffltou cn«ci/2**^Lr*> ioi2 2]*i/r. c©*ff*»fci\ KfflMfc* 

[0 1 1 5] CCT, 1IKMMAK. El***-*©** 5W3Rffiar^©Ki»HlK:j:-»r«iE-J-*. 

Mi, C©f -*©$dffiBtt©JaHKS-J-* 1 HSR# [0123] (£ffi©JftB4 )B11B. HJ&©0£3 
©«« (B«f s -**JBt»3nri»S«««:||| , rS) i 20 <D%%KiPfrZmmm*m^tci}7-Wto<0f§lBiti 

i-sttffl&'c&z. wmf-^imn sti-c^zm®* nsfttoo^zr&o&tmf&ztfcrtt 

£t»©tt. C©i^f s --**#IHt/trai? ! -ir©fcill 5. 01 ItCbl'T. Jtlfc©m3£n-©ltf&fc'i-ft 

«W©8Bltf I -**lfWr*3&>6-C*5. t©K-3i»rt*. H0£H-©l»**ttU UfflteW* 

[0 116] $tc. *<&W$S[w (x. y) B. --3©? rs. 

7**rt{c*S&ijJJHC*fLTB> E©**&ffi£i.& [0 12 4] *Hte©Jf^©#«[B. *5-H«{Ctet> 

Jr5ftia:£;*tt. *5^f«Hi©MR (-J-ftfofc. »5 Ti»f«lttlttll. *»5?HHWCJ:9. ±&©(ft 

*5^*©B8R<!:«-rSBJR) Koi>r«. -tttifcK 1 1) K*»W5**«HRw (x, y) t^iE^SC tV 

&}E<Dtb2t£&ZtZ£'><iC8M$tiZ («#M»wB AS. ' fOMWBJUS'Ctt. * 5* *©*#K#@ 

fifc&SCitt&iO . -3*0. tt©f 7X*£©»# iir-f *fflHl/-Cl>a#. * 5 x 

[0 1 1 7 ] CtUCi^ (RID *«/Mt-T6^a fci»^©1«BMWB0TBIif e -*©IIHIttfft9 4 

«WK*jt*SEItffl©a*tt. *7X*J£S-C*tr<£ ©"CAS. 

fbU — 3©*5^*rtrtHt6*>KSEffc-r*J:9Kft [0125]«T. it»y«KttW»1 7 0 3*»J:C«E 

*. Tfctofc. — ?©*7X*(CJS-f •ST'- *©*»*! Mf-jrOffnBffl 7 0 4«Mbff(COCyCH9rrS. 

i$©S08r- * ©fcjttt. *©fc»««©JBH©HJR-C [ 0 1 2 6 ] X » yttStttttilS 1 7 0 3 B. * v -«« 

ibot, a>-o. *©*5**KBw-aH*©ffi*fi*# ©s^K-x»rx»y5jus*ftirra. x^sss 

l*3-CB. SE8MB. MH©m©HifIfftSW& l/-C4> 43B2iSi[l®e«3ie©2*«I©¥^«) . *>L<B, R 

L-fo?t63!r>ic^bLrt,»<. io GB^n-e^©^©^I2©^;i'A©fniorit»T 

[0118] mKZ'rvzftmt&momm s. x?y&gB±§a©«Hcgfi7)<¥©M#©j$ 

©HJg©^gM£*S<Mft£C£Kfci3. CCT, gg *>6ft»l/Tfc <fct,>. 

$«©*»&#&£?- -5 C 4 KttS. [0127] EH* 8 - *©ffllfflSP 1 7 0 4 tt. Eftttf-g 

[0 119] CfttCfcO. fe©«Sf{c^STS«fc J >KE 91 5ftJ:£EiMl! (SI), EJtf-dfCfcflHMI 

(If'-ifKfcJglSWjEttKJgBJiShSCiKa*). #5 gf£SB 1 6 CC<I:*3¥fflGflHfll ( S 2 ) , ?7Z$<)>? 

hb*£ E*a*i ©nrc. mm • w*©&fiwKtiig gqi7oi{cj:4^7x mm ( s 6 > . * ? y«K* 

(t-Sf SJ:5«:&s. J: Sx»y»a (S7) *»e>, £»■?*-*©*» 

[0120] (»ll) i&Mlt&XXMWc*tt& «w«c*»*raMi*9Ht-j-*. 
EStfiKOftflJB. WT©J:9K:*»6ti*. Tttfe*. 50 [0128] Eig^-^^fiiiiStcfcWSEfMB. 



(S6) mMT-toxmmmtcm 



mmvmui Qfrh&tiznmmmm®. (S2> 



x*;U¥-E (»ii) cn*S/Wbf*SE 
««©^iil/-C9H£3ti5. 

[0113] 

[ttl 1] 



[0112] m&?-M!mfflm*sttz>vm®ti.> * 




(12) 



21 



2000-230809 
22 



mKmrnrnvvsmmoftfid o^Jc^t©**^ * t o 1 2 9 3 
*--e (tti 3) *s«u ztizmMttzm&m® mi 3] 



[oi3o] cc-c, mm®MmMT-z<Dxmm 

$fc. m&Wm (x. y) B. (ttl 1) (C 
*ttS«*H*w (x. y) *x 7 ysfflt«:J:o"C»jE 10 

Lfcfe©-c*s 0 

[0131] x?^3${g(C<fcSfi#©fiiEB> x 
It© A # l » i C 5 r S < ft * J: 5 K HjE-J- S . 

Cfttcfcfl. (»1 3) %^t***£3M(*IC*t*« 

*rtra:if&*»«:£{tra. *fc. K»&$©JaH©E 

fiffiiB. d?7X^'J>y©^m{Cj6Dr, Isl-i'^x 
*©B*K*ttSra*ttifc«»6*KSa«l,. 
5^j»©Ii*«:*jW*aaifliB^l»i«cS. se> 
tc. &aiWiW©xyi^*©**^!ii*fc*i>TE* 20 

[0 132] (ttl 3) ©x**«F-flE:ftJ«l*RS 

[0 133] 
[ttl 4] 

flivad a^ swdd afd 

a* ai + %i j + ay aj, + " 

[0134]C©(ttl4) *»fc*i*8HW«c*w* 
B«il©»*«, Kfflffi. JftffS 

3Rffi«ct©8ft«IH|[(Cj:-)T»S3*i*. 30 

[0 135] 

raraucfct? sifjR • w*ra©«#4. * ? -me 

*5WS9f*-»«BI©«ISii-a3'tt. SEiS@jf£*m> 
5 -H®PgH^B#©Bum^ft:IS?P©^fflffla ; &[Sl± 
;* -it SC *fc. *av*-©J:5{C?Hi4 

H-&CCT5C £tt < . IOTilfr6A«I*©*Mt*» 
fflO. *5-H*©HHMfc*ff5C4*sr*. *©Hffl 

[Bn©n*&IMi] 40 
[01] **6W©*1I©#«1 KfcW*. E8tiffl«s£ffl 

(,>fc*;5 — iMjf^cOP^^f t^Sr^fT "5 /«:#>© i'* r A©£fttit 

(8*5^^0 f ^0 

[02] mmwrn i ->xf- A©is^ciifp* 



[0 3 ] mmmm 1 K*>wsgg«r- * mrmmom 

[04 ] HJ&©0/£ 1 KfcWSrat**- *©Mfflat*«: 

t&BjjT£fc#>©0 

[05 ] Jtft©fftt 1 KfctfSggfif 1 -* ttflBttffiSi 

[06 ] mrnvm i cc*sws@i«iP§®{fcgfi©«iJ!S4 

[07] #3m<D^M<z>&i&2t l ci<5V zi<>i;y r -{ > 
^©«fiS*is-r^D » ^0 

[0 8 ] ggtt©££2 Kfetf SEI*^- *M£g©flt 
UaSt^Oj *0 

[09] *^©H*©^S8 3 CCteW § U > y 7 r 4 > 

[0io] fmoimsicisttz??** yvrnto* 
rat**- ^©^»ffi^^i«B^-rs/c4«)©0 
[0in m&®im4! l cmz>i'>v>7 r 4>#<DW 

[ft#©iftg» 
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